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The demand for high-density data storage with ultrafast accessibihty moti- 
vates the search for new memory implementations. Ideally such storage devices 
should be robust to input error and to unreliability of individual elements; fur- 
thermore information should be addressed by its content rather than by its 
location. Here we present a concept for an associative memory whose key com- 
ponent is a superconducting array with natural multiconnectivity. Its intrinsic 
redundancy is crucial for the content-addressability of the resulting storage de- 
vice and also leads to parallel image retrieval. Because patterns are stored non- 
locally both physically and logically in the proposed device, information access 
and retrieval are fault-tolerant. This superconducting memory should exhibit 
picosecond single-bit acquisition times with negligible energy dissipation during 
switching and multiple non-destructive read-outs of the stored data. 

The key component of our proposed associative memory is a superconducting array with 
multiple interconnections (Figure 1), where each bit is represented by a wire and thus is phys- 
ically delocalized. More specifically this network consists of a stack of two perpendicular sets 
of parallel wires separated by a thin oxide layer.Bll At low temperatures a superconductor- 
insulator-superconductor layered structure, known as a Josephson junction,il@ exists at each 
node of this array; logically each pattern in our proposed memory is stored nonlocally in 
these A^^ interconnections. We note that in this network each horizontal/vertical wire is cou- 
pled to each vertical/horizontal one by a Josephson junction so that in the thermodynamic 
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limit (A^ — s> oo for fixed area) the number of neighbors diverges. 

The important energy-scales of this long-range array are those associated with the su- 
perconducting wires and with the Josephson junctions. Each superconducting wire is char- 
acterized by a macroscopic phase which is constant in equilibrium; here we assume that 
phase slips in each wire are energetically unfavorable. Application of a magnetic field re- 
sults in the rotation of this phase, where the rotation rate is determined by the amplitude 
of the applied field.i The interaction energy of a Josephson junction is minimized when the 
phase difference across its insulating layer is zero. In the absence of a field this condition 
is satisfied at each junction of the array. However application of a field transverse to the 
network results in an overconstrained system since the 2N phases and the A^^ Josephson 
junctions have competing energetic requirements. The identification of the ground-state in 
such a system is a hard combinatorial optimization problem,il0 as the number of metastable 
states scales exponentiallyi with the number of wires, A^. 

Because of its high-connectivity, the long-range Josephson array is accessible to analytic 
treatment; furthermore it can be fabricated and studied in the laboratory.iS A detailed 
theoretical characterization of this network has been performed.!! At low temperatures the 
system has an extensive number of states, Nstates ~ where c ~ 0(1), separated by 
free energy barriers that scale with the number of wires, A^. Its specific low-temperature 
configuration is determined by sample history, a feature also observed in glassy materials. 
Experiments have confirmed predicted static properties of this multi-connected array, though 
detailed dynamical investigations in the laboratory remain to be performed.0 

The proposed superconducting network (Figure 1) has long-range temporal correlations 
(memory) and an extensive number of metastable states, and thus it is natural to explore its 
possible use for information storage. Indeed high-connectivity and nonlinear elements (e.g. 
Josephson junctions) are key features required for the construction of associative memories.0 
Here one would like to store p patterns in such a way that if the memory is exposed to another 
one (^i) with a significant (> overlap with a stored image (^j), q = j^Y^f ^iCi^ then it 
produces ^. A simple model for such a memory is based on an array of McCuUoch-Pitts 



neurons (Figure 2). The patterns are stored in the couphngs, Jij. Each nonhnear element 
has multiple inputs, and the output is a nonlinear function of the weighted sum of the inputs. 
The McCulloch-Pitts network, with inputs rti G {0, 1}, can be reformulated as a spin model 
where = 2?ij — 1; then the output is 



and the couplings Jij can have arbitrary sign. Clearly the output is robust to errors in the 
input due to the multiple connections present. 

In order to ensure that the McCulloch-Pitts array is content-addressable, the couplings 
must be chosen so that the stored images correspond to stable configurations of the network. 
Hopfield has proposed an algorithm^! where the desired patterns are local minima of an 
energy function, e.g. H = —^Y^ij JijSiSj where Si G {—1,+!}. The couplings are chosen 
so that the energy is minimized for maximal overlap of Si, the array configuration, and the 
desired output, ^j. For one pattern, this condition is satisfied for Jij = j^^i^j where N is the 
number of elements in the array; then H = —i^ iJZi Siiif' ■ We note that with this choice 
of weights Jij the output is 



for all i since = \ where and ^i are the desired inputs and outputs respectively. We 
note that, according to (|^) with the discussed choice of Jij, a real input Sj ~ S,j yields the 
desired output if it has errors in less than half its bits. In the Hopfield model, the couplings 
associated with several stored images are simple superpositions of the one-pattern case such 
that 
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where fi labels each pattern. The total storage capacity of the network, Pmax, is dependent 
on the acceptable error rate; in general Pmax = o^N where a < 0.138 if the probability of 
an erroneous bit in each pattern is Perror < 0.01. Here we discuss the Hopfield algorithm 
because of its simplicity, but we note that other more efficient algorithms^ can also be 
implemented in this network. 

The long-range Josephson array (Fig. 1) can be adapted to become a superconducting 
analogue of a McCulloch-Pitts network. It is described by the Hamiltonian 

'H = ReJ2S*JfjSj (5) 
jj 

with 1 < < N where j and j are the indices of the horizontal and vertical wires 

respectively; Sj are effective complex spins with unit amphtude, Sj = e^'^^ where (f)j is the 
phase of the j-th. superconducting wire. The couplings are site-dependent and are related 
to the enclosed flux, in a given area whose edges are defined by wires j and j such that 

J 27rz$.7 . , 

Jn = —= exp — — (6) 

where $0 is the fiux quantum. For a uniform magnetic field H, $jj = H{jjP) where / is the 
interwire spacing. We emphasize that the sign of Jjj in (^) can be both positive and negative 
depending on the value of In complete analogy with our previous discussion of the 
McCulloch-Pitts network, patterns are stored in this superconducting associative memory 
by appropriate choice of the weights, Jjj. Because the Jjj are functions of the enclosed fiuxes, 
they can be set to their desired values by appropriately tuning the local applied field Hjj. 
In practice this writing procedure could be accomplished by an array of superconducting 
quantum interference devices (SQUIDs) superimposed on the multi-connected Josephson 
network.^! 

The stored patterns are encoded in the Josephson couplings of the long-range array and 
correspond to stable configurations of the 2N superconducting phases. A "fingerprint" of 
each image can then be determined using voltage pulses and the Josephson phase-voltage 
relation Acp = ^ J Vdt where A0 is the phase difference across the relevant junction.SS 



More specifically a set of voltage pulses can be applied to a small subset (> ^/N) of the 



horizontal wires, a "key", thereby altering the phase differences at the associated nodes. 
The phases of the vertical wires must readjust in order for the system to settle into a stable 
configuration, a process which results in the absence/presence of a voltage pulse. The set of 
key input and output voltage pulses therefore constitutes a signature of each stored image. 
Single-fiux quantum (SFQ) voltage pulses, where / Vdt = $o, may be used for direct analogy 
with the McCuUoch-Pitts array where inputs nj G {0, 1} now refer to the absence/presence 
of a SFQ pulse. Again it is convenient to describe the network in terms of the variables 
= 2ni — 1. Following the Hopfield algorithm, the local coupling associated with one 
pattern is Jjj = jfCjC] i^i accordance with (|) so the the desired output C,j = JjjSj is robust 
for Sj ~ ^j. The weights coding many stored patterns are superpositions, (^), of the one- 
pattern cases. From a practical standpoint, these couplings are "written" by local (uniform) 
fields applied to individual plaquettes of area for a cell with its lower left-hand corner 
defined by the Cartesian coordinates the plaquette flux, ^piaquettey related to the 

weights by the expression 



where B(x) = 1 if x > and 0(x) = otherwise. Again we note that other algorithms 
can be used to determine the couplings; here we use the Hopfield model as an illustrative 
example. 

In the proposed superconducting memory, each stored image is coded by a distinct set of 
superconducting phases associated with weak supercurrents and negligible induced fields. 
In conventional superconducting memories/logic, digital information is stored locally in 
trapped magnetic fluxes that are switched between SFQ states, $ G {0,$o}) by Joseph- 
son junctions;0'0 therefore the associated supercurrents should be large and can lead to 
unwanted crosstalk between adjacent elements. However in order to maintain their advan- 
tage in speed compared to other memory technologies, Josephson junction devices must use 
SFQ for both information storage and retrieval. This condition is satisfied by the design 
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of our proposed memory where the Josephson junctions switch fluxoids while the apphed 
magnetic fluxes remain fixed; it is not the local fields but the supercurrents that store the 
information. 

The fault-tolerance of the long-range Josephson network discussed here is due to the non- 
local nature of its data storage both at the physical and the logical levels. In conventional 
planar superconducting arrays there are 0{N'^) individual short superconducting wires and 
the fluxoids are spatially confined to areas A P where / is the internode spacing. By 
contrast, in the multi-connected network the phases reside on the 2N wires of length Nl; 
thus the fluxoids here are extended to the entire system. Data is coded nonlocally in config- 
urations of these superconducting phases, similar to the situation in an optical holographic 
storage device .0 There the stored patterns are independent of the input and an analogous 
superconducting holographic memory can be constructed. For example, let us consider the 
input wavefunction 

vl>? = exp27rz0? = exp^ (8) 

where j and p are indices labelling the horozontal wires and the stored patterns respectively. 
Then the input voltage pulses would be / Vdt = $o where [ ] refers to the fractional 
part. Using the Hopfield algorithm, we have Jjj = -^Y.pCj'^] which yields the desired 
output = J2i Jh"^-- We note that any orthogonal basis for the inputs will work; therefore 
this long-range Josephson array can be used as a key component of both an associative and 
a holographic memory. 

Practically, the proposed superconductor memory cell consists of the superimposed 
SQUID and long-range networks for writing and reading respectively, and a phase reset 
circuit. Each data retrieval event in the READ array must be followed by a reset operation 
since the output signals correspond to phase differences with respect to a reference state. 
This reset circuit can be constructed from a series of double-junction SQUID loops connected 
to each horizontal wire of the multi-connected array with a variable coupling to ground; if 
finite this coupling locks the relevant phase into a reference state, whereas if zero (e.g. in the 
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presence of a control line current) the next data retrieval process can be per formed. 113 This 
memory cell can then be embedded in an enviroment with known input/output SFQ circuitry 
that includes DC/SFQ voltage pulse converters and SFQ transmission/amplification lines.0 
The network parameters, the charging [Ec) and the coupling (Ej) energy scales, should be 
chosen to optimize performance, particularly to maximize access rate, u ~ min(A, y/ EcEj) 
where A refers to the superconducting gap. An additional constraint on Ec {Ec < O.OlEj) 
results from the condition that phase fluctuations remain weak and do not result in er- 
rors. Given these constraints, the minimal dissipation per bit (~ Ej) is roughly lOA which 
is ~ 10^^^ joule for aluminum in contrast to its value of ~ 10^^^ joule for conventional 
semiconducting electronics.^ 

In summary, we have proposed an associative memory device that is a superconducting 
analogue of a McCuUoch-Pitts network. It is content-addressable with a single-bit data 
accessible time, ta, that is determined by the superconducting gap and the charging and 
coupling energy-scales in the network. Moreover because this memory is intrinsically parallel 
due to its crossbar design, an image of bits can be retrieved in a time (per bit) tdt ~ 
by contrast tot = ta in a conventional local memory. For example, an array of = 1000 
wires with / = 0.5/i has a capacity of C = O.IA^^ = 10^ bits; a set of such arrays on a typical 
Icm^ chip would then have a capacity of 1 Gigabyte with an image access time (per bit) 
of tdt = 10~^^ seconds. The fault-tolerance of this superconducting memory enhances its 
appeal as a candidate for ultrafast high-density information storage without conventional 
problems of power dissipation and subsequent heat removal. As a point of comparison, we 
remark that this proposed device is faster but has lower absolute capacity than the best 
optical holographic memories;ll3 this is because the latter are intrinsically three-dimensional. 
We end by noting that we can tune the long-range array such that its stored images are 
maximally distant from each other in phase space. In this case the matrix elements associated 
with external noise will be negligible, and these patterns will have long decoherence times. 
Such orthogonal configurations could be promising as basis states for quantum computation. 
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Figure 1. A schematic of tlie long-range superconducting array discussed in the text; the horizontal 
and vertical wires are coupled by Josephson junctions at each node and the vertical arrows refer to the local 
fields applied to individual plaquettes that determine the weights. 
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= sgn(J^ jjj ^j) 

Figure 2. Schematic diagrams of (a) a McCulloch-Pitts neuron (b) a McCulloch-Pitts network where 
= ±1 and the Jij can have arbitrary sign. The high-connectivity and the nonhnear elements in the 
McCulloch-Pitts array are crucial for its content-addressability and fault-tolerance. 
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